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Abstract 

o 

We show that the value function of an optimal stopping game driven by a one-dimensional 
diffusion can be characterised using a modification of the Legendre transformation if and only 
if the optimal stopping game exhibits a Nash equilibrium (i.e. a saddle point of the optimal 

CO 



stopping game exists). This result is an analytical complement to the results in 19 where the 
'duality' between a concave-biconjugate which is modified to remain below an upper barrier 
and a convex-biconjugate which is modified to remain above a lower barrier is proven by 



i— i appealing to the probabilistic result in 18 . The main contribution of this paper is to show 

u that, in this special case, the semi-harmonic characterisation of the value function may be 

proven using only results from convex analysis. 
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1 Introduction 

oo 

This paper examines the connection between convex analysis and optimal stopping of one- 
dimensional diffusions. The connection between convex analysis and optimal stopping dates 
back to Dynkin [7J where the solution to an optimal stopping problem of the type 

o 

CO V{x) = su V E x [G(X T )] 

1 *e X , a Markov _ - « c — *. ^ su , rh „ _ t of 

the gains function G. When X is a one-dimensional diffusion, the corresponding superharmonic 

5-H 



functions can been characterised in terms of a generalised type of concavity (see 10 pp. 115). 
This so called 'superharmonic characterisation' of the value function is discussed in further detail 
in |20| Chapter IV Section 9, to illustrate the properties of the solution to certain free-boundary 
problems associated with optimal stopping problems. More recently, the change of time and 
scale technique underpinning the superharmonic characterisation was 're-introduced' in |6|. 

The minimax version of this problem is referred to as an optimal stopping (or Dynkin) 
game. The sup-player selects a stopping time r with the aim of maximising the functional 
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R x (r, a) = E x [G (X T ) h T <a] + H (X a ) I[ T >o-]] while the inf-player selects a stopping time a with 
the aim of minimising the same functional, optimal stopping games are explained in more detail 
in section [2] below. A variant of this optimal stopping game was first studied by Dynkin [9] 
using martingale based methods. These problems have also been approached via variational 
inequalities in [2] and [3] . General conditions which ensure that such a saddle point exists have 



been studied in 11 and |12|. Optimal stopping games have been applied to solve problems in 



finance, see for example, [I], [13], (13], (15], [16] or [TT]. 



In 18 , the superharmonic characterisation of the solution to optimal stopping problems 
has been extended to optimal stopping games where it is shown that the value function is 
a ' seminar monic' function. The value function is shown to be the smallest function which is 
superharmonic and dominates G on the set {V < H} as well as the largest function which is 
subharmonic and minorises H on the set {V > G}. It is shown in |18| that a single function with 
both these properties exists if and only if the optimal stopping game exhibits a saddle point. 
When the underlying Markov process is a one-dimensional diffusion, these dual problems have 
been formulated in terms of a generalisation of the Legendre transform in |19| . 

The purpose of this paper is to establish the 'semi-harmonic characterisation' of the value 
function of optimal stopping games driven by one dimensional diffusions using purely analytical 
techniques. This requires us to modify some of the basic objects of convex analysis to account for 
the additional constraint on the domain of the smallest superharmonic majorant (resp. largest 
subharmonic minorant). The next section formally introduces optimal stopping games and sign- 
posts the contents of the rest of this paper. 

2 Semiharmonic characterisation 

Consider a stochastic basis (fi, ¥, {P x } x£l ) supporting a one dimensional diffusion X = 
(Xt) t> Q with Xq = x £ / C R under P x . The level passage times of X will be denoted by 
T y = inf { t > I Xt = y}. The state space / of X is an open interval on R i.e. I = (a, b) and the 
boundaries of / are natural, i.e. P x (T a < 00) = P x (Tj, < 00) = for all x G I. The diffusion X 
is also assumed to be regular in the sense that for all x £ I, P x (T y < 00) > for some y > x. 
A Borel measurable function U : I —> M is r-superharmonic with respect to X if 

U(x)>E x [U (X T ) e- rT I [T<oo] ] 

for all x € I and all stopping times r. The function U is r-subharmonic with respect to X if 
U (x) < E x [U (X T ) e~ rT I[ T<00 ]] for all x £ I and all stopping times r. Moreover, U is referred 
to as r-harmonic, if it is both r-superharmonic and r-subharmonic. 

The generator of X is denoted hx and under some additional regularity conditions (see [4] 
Section 4.6) can be expressed as 

h x f (x) = v (x) A/ {x ) + D ( X ) ^/ ( X ) 

for x £ I where fi is the drift and D > is the diffusion coefficient of X. Take a constant r > 
and consider the ODE 

h x f(x) = rf(x) (2.1) 
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which has two linearly independent positive solutions, denoted cp and ip. As the boundaries of / 
are natural, ip and ip may be taken such that <p is increasing and ip is decreasing with 

<p(a+) = tp(b-) = ; <p(b-) = ip(a+) = +00. 

The functions tp and ip are shown in 23 V.50 to be continuous, strictly monotone and strictly 
convex. Furthermore, for y & I , the process {e~ r ^ tATy ^(p(X t /\Ty))t>o is a (P x , J^ATjJ-martingale 
for all y > x while (e~ r ^ tATy ^ip(X t/S T y ))t>o is a (P x , J 7 4A r j/ )-martingale for all y < x. For x,y E I 
the Laplace transforms of the first passage times may be expressed as 



for x ^> u 

-C's |_e ! 'Jlrj / <oo " " 



^fy forx<y 



Definition 1. Let J : I ^ M be a monotone function. A Borel measurable function f : I 
is J -concave if 

f(x)> f( v) J ^- J ^ + f(z) Hx)-J{y) 

for x E [y, z] C I. The J -derivative of f is denoted 

d , r f{y)-f{x) 

- f (x) : = hm ■ 



d J ylx J (y) — J (x) 

Define a pair of strictly increasing functions 

F{x) = ^M . p {x) = _tM = (2 .2) 

ip (x) ' ip (x) F (x) 

it is well-known (see [§] Theorem 16.4) that a Borel measurable function U is r-superharmonic 
if and only if U/ip is F-concave, or equivalently, U/<p is F-concave. For a<y<x<z<b the 
Laplace transforms of the exit times from the open set (y, z) G I are 



E x [e- rT ^ { T v <T z 



ip (x) F{z)-F (x) _ip(x)F (z) - F (x) 
J¥) F (z) - F (y) ~ Viv) F (z) - F (y) 



-r-rr.ir 1 _^^) F(x)-F(y) _ V (x) F (x) - F (y) 

Ex 16 I[T ^ ]l ~ J¥) F (z) - F {y) ~ Hz)F(z)-F( y y M 

Take a payoff function G : I — > K which is upper semi-continuous and such that for all x £ I, 



P x [limG(X t )e- rt = c =1 , F x 



t—>co 



sup \G (X t ) e 
,t>o 



- rt 



< +00 (2.4) 



for some c E M. Section [3] focuses on an alternative characterisation of the solution to the 
discounted optimal stopping problem 

V (x) = sup E x [G (X T ) e- rr ] . (2.5) 

T 

The problem will be approached via the concave biconjugate of a transformed objective function 
as in [19] but without reference to previous results on the superharmonic characterisation of the 
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value function (see 20 Chapter 1 and the references therein for further details). Theorem [3] 



shows that the function x i— > V (x) defined in (2.5) solves the 'dual problem' 



V = inf F 

FeSup(G] 



(2.6) 



where 

Sup (G] := {F : I — > [G, +oo) | F is continuous and r-superharmonic} . 

Hence Theorem [3] provides a proof of the superharmonic characterisation of the value function 
in this specific case using only analytical tools from convex analysis. 

In section [4] we examine the smallest .F-concave function lying above the function G yet 
below the function H. The functions G, H are continuous and for all x € I satisfy: 



G{x) <H(x) 



-Ei- 



sup \G (X t ) e 
t>o 



-rt 



< +oo 



E ,■ 



sup \ H (X t ) e 
t>o 



-rt I 



< +oo 



and 



P x ( lim G (X t ) e~ rt = lim H (X t ) e"^ = 1. 

\t— »oo t— >oo / 



(2.7) 
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Under these assumptions on G and H it is shown in Theorem 17 that the smallest F-concave 



function dominating G which is below H coincides with the largest F-convex function minorising 
H which is above G. 

Section [5] studies the solution to the optimal stopping game with lower value V defined as 



V (x) = sup inf E x (G (X T ) I [t < ct] + H (X a ) I [r>a] ) e -(- A -) 

and upper value V defined as 

V (x) = inf sup E x \(G (X T ) I [r < ff] + H (X a ) I [r>a] ) e~ r ^ 



(2.9) 



(2.10) 



where G and H satisfy the assumptions outlined above. For ease of notation, the objective 
function is denoted 



R x (t,ct) := E x 



{G(X T )l [T < a] +H(X (7 )l [T>a] )e 



-r(rA<r) 



(2.11) 



The optimal stopping game has a Stackelberg equilibrium if the upper and lower values coincide, 
i.e. Y_(x) = V (x) =: V (x) for all x £ /. In 11 and 12 it is shown via probabilistic means that 



this game exhibits a Stackelberg equilibrium when both (2.7) and (2.8) hold. The assumptions 
in 12 are slightly more general, in which case the Stackelberg equilibrium is determined by how 



the objective function is specified at the natural boundaries. A saddle point is a pair of stopping 
times (t* , cr* ) such that for any other stopping times r, a 

Rx(T,a*)<R x ( T *,a*)<R x ( T *,a) Vie/. 

The optimal stopping game exhibits a Nash equilibrium if the game has saddle point. In par- 
ticular, existence of a Nash equilibrium implies a Stakelberg equilibrium exists but the converse 
is not true. The result in [11] (which applies to more general processes) shows that, under the 



assumptions (2.7) and (2.8), the optimal stopping game described above has a Nash equilibrium. 
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Under the weaker assumptions used in [12] a saddle point need not exist, the conditions under 
which Nash equilibrium fail are discussed in Section [5j Introduce a pair of dual problems 



V := inf F 

F£Sup[G,H) 



V := sup F 

FeSuh(G,H] 



(2.12) 



where the admissible sets of functions are 



Sup [G, H) 
Sub (G, H] 



{ F : I — > [G, H] | F is finely continuous 

and r-superharmonic on {F > G} and {F > V}} , 

{ F : I — > [G,H]\ F is finely continuous 

and r-subharmonic on {F < H} and {F < V}} . 



It has been shown in [18] Theorem 2.1 that when (2.7) and (2.8) hold V = V and that the 



value of the dual problems coincides with the value of the optimal stopping game with upper and 



lower values (2.9)-(2.10) if and only if the optimal stopping game has a Nash equilibrium. In 119 



the dual formulation (2.12) was used to show that the value functions of optimal stopping games 



based on one dimensional diffusions absorbed upon exit from a compact set can be represented 
using a modification of the Legendre transform. Section [4] provides converse results to 19 by 
deriving the duality between these generalised Legendre transforms without appealing to results 
from optimal stopping. Section [5] relates the modified Legendre transformations introduced in 
19 to the dual problems ( 2.12[ ) and the solution of the optimal stopping game. In Theorem 18 



the optimal stopping game (2.9)-(2.10) is shown to have a Stackelberg equilibrium. Theorem 



22 shows that when (2.7) and (2.8) are assumed to hold the value of the dual problems (2.12) 
coincide, i.e. V = V , and the the optimal stopping game exhibits a Nash equilibrium. 



3 Optimal stopping using the Legendre transformation 

Before proceeding to solve the optimal stopping problem ( |2.5[ ) , we shall first recall the definition 
and some properties of the concave biconjugate. Let / : dom (/) — > R be a proper, measurable 
function on the domain dom(/) C M. The concave conjugate of /, denoted /*, is defined for 

celas 

/*(c)= inf (ex - f (x)) . 

x£dom(/) 

The concave biconjugate of / is defined as 

/**(»= inf ( X y-f*(y))= inf sup (y (x - c) + f (c)) . (3.13) 

j/edom(/*) yedom(f*) c6 dom(/) 

The epigraph of a function / is the set of all points above the graph of /, that is 

epi(/) := {(x, fi) G M 2 \ M > / (x) } . 

The convex hull of the set epi (/) is the intersection of all convex sets containing epi (/) and is 
denoted conv (/). With a slight abuse of notation, let 

conv (/) (x) := inf { y G K | (x,y) G conv (/)} , 
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then — /** is the upper semi-continuous modification of conv (— /) (x), see [22] Theorem 12.2 and 
Corollary 12.1.1. A constant c G R is a subgradient of the function / at x G R if 

f(z)>f(x) + c(z-x) VzGM. 

The set of all such supergradients, denoted 

df(x):={ceR\f(y)-f(x)<c(y-x) Vy G R} (3.14) 

is referred to as the superdifferential. The function / is referred to as concave at x G M when 
df (x) 7^ 0. When / is concave and differentiable at x then df (x) = {/' (x)}. 

The next lemma characterises the set upon which / coincides with /**. The proof illustrates 
how x i — y (x) can be constructed using a spike variation. 

Lemma 2. Any function / :1->1U {+°°} coincides with its concave biconjugate on the set 

{x G M | /** (a?) = / (x)} = {x G R | df (x) ^ 0} . (3.15) 

Proof. Suppose that 9/ (x) 7^ and take c £ df (x) then by definition / (y) + c (x — y) < p for 
all p > / (x) and all y G R. Hence 

/* (c) := inf (cy - / (y)) = cx - f (x) . 

Consequently, /** can be written as 

/** (x) = inf (c (x - x) + / (x)) = / (x) . 

so {x G R I df (x) 7^ 0} C {x G R I /** (x) = / (x) }. To show this inclusion holds with equality 
assume that df (x) = and for a fixed c G M let 

e(x;c) :=inf{e>0 | / (y) + c (x - y) < / (x) + e VyGM}. 

It follows that 

-/* (c) = sup (/ (y) -cy) = f (x) + e (x; c) - cx, 
and /** can be written as 

/** (x) = inf (cx - /* (c)) = inf (/ (x) + e (x; c)) . (3.16) 

Let 

e* (x) := inf {e > | 3 c G M s.t. / (y) + c (x - y) < / (x) + e Vy G M} (3.17) 



so that {x G K I e* (x) > 0} = {x G K | 9/ (x) = 0}. Hence we may conclude from (3.16) that 



when 5/ (x) = 0, /** (x) = / (x) + e* (x) > / (x). □ 



6 



Let W : [0, oo) 



be defined as 



W(y) :-- 



% ) o (F)- 1 (y) 
limsup^^g* 



for y > 
for y = 



(3.18) 



where F was defined in (2.2) and G + = G V 0. Similarly, let W be denned via 



W (y) :-- 



limsup xt6 ^^ 



for y = 
for y < 



(3.19) 



o (*T X (y) 

The next result is the main result in this section and it shows that the value function V defined 



in (2.5) is such that V/ip coincides with W** o F where W** is the concave biconjugate of the 
function W. The value function V is also such that V/tp coincides with W** o F where W 7 ** 
is the concave biconjugate of the function W. These transformations are used as the function 
y i->- W (y) (resp. y \-t W (y)) is concave if and only if x \-t (G/ip)(x) is F-concave (resp. 
-F-concave). The case that both boundaries are absorbing has been handled by showing that 
W** (F (x)) V> (x) solves (Q in [19] Theorem 3.2. 



Theorem 3. Assume that G : I 



is an upper- semicontinuous function satisfying the as- 



sumption (2.4) and such that W (0) = W (0) = 0. Consider the stopping problem (2.5), then 

V{x) = W m (F(x))^(x)=W**(F(x))ip(x). 
The stopping time which attains the supremum in (2.5\) is t* = T a * A T^* where 



a 

b* 



(3.20) 



sup { a < x I W (F (a)) = W** (F (a))} , 
inf {x < b I W (F (&)) = W** (F (b))} , 

so F (x) = E x [G (XT a *AT b *) e _r ( Ta * ATb *)] . Furthermore V solves (2.6). 

Proof. The definition of W (0) and W (0) ensure that 

W,*(F(x))if>(x)>0 ; W**(F (x))ip (x) > 

for all x E («,&)• Let (b n ) n>l be a sequence of real numbers such (a, b n ] C (a,b), b n < b n+ \ for 
all n > 1 and (a,b n ] — > (a, b) as n — > +00. Fix x G (a,b) then for some sufficiently large N, 
x G (a, 6 n ] for all n > N . Denote by 5 : / — > {0, +00} the 'characteristic function' of a set ^4 
which is defined as 

+00 for x <E A 
for x A 



5(x\xeA) :=| 
and introduce a function VFr, defined as W„ (x 



(3.21) 



defined in (3.18). Let X? := X tATb 
problems 

V n (x)= S upE x [G {X™) e 



W (x) — S (x I a; G I \ (a, b n ]) where W was 
and consider the following family of optimal stopping 



(3.22) 



where G satisfies limsup^ G + (x) /ip (x) = 0. An optimal stopping time for each of (3.22) exists 
(see 20 Chapter 1 Theorem 2.7) and is the exit time from an open set containing x so we may 
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write the optimal stopping time for (3.22) as r* = T a * A Tb» for some a < a* < x < 6* < 6„. 
Furthermore, each r* < Tk n , r* < r* +1 for all n > 1 and lim n _ >+00 r* = r* P^-a.s. for all 
x G R. For all n > 1, X"* = X T * and the process X is left-continuous over stopping times so 
lim n ^. +00 XJp* = X T * i-^-a.s for all i6R, The assumption (2.4) implies that (G (Xt) e_r *) t>0 i s 
uniformly integrable so it follows that 



lim V n (x) 

n— >oo 



lim E x [G(X?.)e 



V(x). 



The process (e _r (* ATi >™ ^tp(X™)) t >o is a (P x , Ft/\T b )-martingale for each b n > x so applying the 
optional sampling theorem yields E x [p (X™) e~ rT ] = ip (x) for all x G (o, 6 n ] and all r < T;, n . 
Hence for an arbitrary c£K 



V n 0) = sup ^ [G (X?) e~ rr ] = (x) + sup [(G (X r n ) - (X?)) e" 



Thus, 



V n (x) 



inf (cp (x) - ME X \{ap {X?) - G (X?)) e~ r '> 



(3.23) 



The next step is to expand the right hand side of this expression in such a way that it converges 
to the concave biconjugate of W as n — > +oo. Using (2.3), the inner infimum in (3.23) can be 
written as 



inf 

a.<y<x<.z<b n 

inf 

a.<y<x<.z<b n 



E , 



M*5 



G(X2 AT ))e 



-r{T y /\T z ) 



c<p(y)-G(y)F(z)-F(x) op (z) - G (z) F (x) - F (y) \ , 



if>(y) F(z)-F(y) i> (z) F (z) - F (y) 

We claim that the right hand side of this expression converges to 
'op (y) -G(y) 



inf 

y<E(a,b) V V (y) 
as n — > oo. To this end, take 



(x) = inf {cy' - W (V) )tp (x) =: W* (c) ip (x) 

j/'>0 



sup {z £ I \W* (c) V (s) = op (z) -G{z)} 
inf{yG/ |^(c)V(2/) = c^(y)-G(y)} 



with the convention that sup = a and inf = b. In general for all a < y < x < z < b r , 
W ^ ( C ) < W(y)-G(y) F(z)-F(x) + op (z) - G (z) F (x) - F (y) 



i/j(y) F(z)-F(y) 



i>(z) F(z)-F(y) 



(3.24) 



When y < x < z + (|3.24|) holds with equality for y = y and z = z + ; when y > x equality 

-G(y-) 



holds when y = a and z = y whereas if z + < x the inequality is strict as 



ap(y)-G(y)F(y-)-F(x) | ap (y~) - G (y~) F (x) - F (y) > c<p(y 



i>{y) F(y-)-F(y) 



F(y-)-F(y) 



for all y G [x, b n ]. We may switch to the other ratio of the fundamental solutions using (2.3) on 
the left-hand-side of this equality and use (p (y) —> +oo as y f b to conclude that 



lim inf 



cv(y)-G(y)F(z-)-F(x) , ccp (*") - G (z~) F (x) - F (y) 



<f(y) F{z-)-F{y) 



cp(z ) 



F(z- 



F{y), 



W*(c) 
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Hence letting n — > oo on both sides of (3.23) yields 

V{x) 



inf 



The argument using the other ratio of fundamental solutions follows analogously. The statement 
about the optimal stopping time follows from the form of the value function provided as the 



stopping region T> and continuation region C for (2.5) are 



C 
V 



{xG I\ V(x) >G(x)} = {xG/ |W** (F(x))ip(x) >G(x)}, 
{x G 1 1 V (x) = G(x)} = {x E I \ W** (F(x))^(x) = G (x)} . 



Finally, W** = — cl (conv (— W)) is the smallest concave function dominating W, so V (x) = 
W** (F (x)) ip (x) is the smallest r-superharmonic function dominating the gains function G (x) 



and hence V (x) solves (2.6). 



□ 



Remark 4. The function y i— >• W (y) (resp. y h- )■ W (y)) is defined at the natural boundary a 
(resp. b) in such a way as to ensure that V (a) = V (b) = 0. In ^ and 121 this condition is 
imposed by defining F {X T (uj)) = on {r = +00} for all Borel measurable functions F . 



Remark 5. // W (0) = W (0) = then a finite optimal stopping time for (2.5) exists whenever 
W is not strictly convex o n (0 , +00) (resp. W is not strictly convex on (—00,0)/ When the 
gains function G satisfies (2.4) then we may assume that W (0) = W (0) = without loss 



+00 and no finite optimal 



+00. When (2.4) fails and G(x 



of generality as when this is not true it can be achieved by subtracting the finite harmonic 
function h{x) = E x [lim^oo G (X t ) e~ rt ~\ from the function V (x) defined in (2.5). When (2.4) 
fails and G grows faster than ip as x — >• a we will have W(0) 
stopping time exists as V (x) > -0 {%) lim^a G (y) ftp (y) 
O (tf)(x)) as x — > a then W(0) is finite but the harmonic function h need not be well-defined. 
The function W^{F{x))ip{x) remains the smallest r-superharmonic function above G, and a 
sequence of stopping times (t^)„>i can be identified such that limn-i^oo r* = r* where t* = 
inf {t > 0| W^{F{Xt))ip{Xt) = G(Xf)}. However, if the convention mentioned in Remark^ is 
adopted it may occur that W**(F(x))ip(x)) > E x [G(X T * )e~ TT ] . 



For fixed x G M. let 
l*(c,p) 
r x (c,p) 

with the usual convention that sup ( 



sup I y < x 
inf < y > x 



G\ P 

1> J i> (x) 



c{F{y)-F{x)) 



-00 and inf = +00. For a given x £ I consider the sets 



A 1 (x) = {p G [G(x) ,+00) I 3c G 
A 2 (x) = {p G [G (x) , +00) I 3 c G 



s.t. (l x (c,p) ,r x (c,p)) C 1} , 
s.t. r x (c,p) = -l x (c,p) = +00} . 



(3.25) 



In Lemma [2] it was shown that x 1— > W** (x) can be constructed by minimising over the l F- 
tangents' of the form y 1— > p/tp (x) + c {F (y) — F (x)) which strictly dominate W on dom (W), 
i.e. W** (x) = inf (x). The next corollary provides a short proof of the 'dual interpretation' 
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provided in [19] which claims that x i-> W** (x) can be also constructed by maximising over the 
F-tangents which intercept W on both sides of the point x in dom (W), i.e. W** (x) = sup A\ (x). 
The latter formulation facilitates the construction of a maximising sequence of stopping times. 

Corollary 6. Let 

e (x; c) := sup {e > | a < l x (c, G (x) + e) < x < r x (c, G (x) + e) < b} 
and set A c (x) := [F {l x (c, G (x) + e {x; c))) , F (r^ (c, G (x) + e (x; c)))], i/ien i/te uaZue function 



of the optimal stopping problem (2.5) can be represented as 



V (x) = sup sup (c (F (x) — y) + W (y)) tp (x) . 



Moreover, V (x) = sup A\ (x) for each x G I where A\ (x) is the set defined in (3.25). 




e(x,c) 



Figure 1: In the non-discounted case (r = 0) and when X is a stan- 
dard Brownian motion this diagram illustrates e(x; c) and e (x; c) 
for a fixed c. 



Proof. For the first statement, note that for each c G 1, by definition 

G (x) + e(x; c) 



ip (x) 



+ c(y-F(x)) >W{y) 



for y £ A c (x) and equality holds for y = F {l x (c, G (x) + e (x; c))). Hence, 

sup (W{y)-cy) = W{F{x)) + e -^--cF{x) 

and it follows that 



sup sup (c (F (x) — y) + W (y)) ip (x) = sup (G (x) + e (x; c)) 

■ yeA c (3;) 



Let 



e (x; c) := inf < e > 



0) W + C (1P W - V ) S 0^£ Vy,R 
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For each c G M, e (x; c) > e (x; c) as illustrated in Figure [T] but to avoid contradicting their 
definitions inf cg iR e (x; c) = sup cgK e(x;c) and hence the result follows from Lemma [2j Further- 
more, it follows from the definition of the set A\ (x) that sup^4i (x) = G (x) + sup cgffi £ (x; c) = 
W**(F{x))ip(x) = V(x). □ 

The next corollary shows that Theorem [3] is capable of handling the case when one (or more) 
of the boundaries is absorbing. 

Corollary 7. Take x G [a, (3] C [a, b] and consider the stopped diffusion X^^ := Xt/\T a p where 
T a ,B = T a A Tp and the corresponding optimal stopping problem 

V a ,p (x) = swpE x G{X^)< 

T 

for G : (a, b) — > R satisfying the assumptions in Theorem^ Then 

V a ,p (x) = (W M )„ (F (x)) V (x) = (W M U(F(x))tp(x) 



(3.26) 



where 



W [aA {y) := W(y)-6(y\F- 1 (y)eI\[a,(3]), 
W[a,pi(y) ■= W(y)-6(y\F- 1 (y)eI\[a,(3}). 



Moreover, the stopping time which attains the supremum in (2.5) is r = T a * A T&* where 

a* = sup{y G [a, x] \ W M (F (y)) = (W M )„ (F (y))}, 
b* = M{y G [x,0] | W M (F(y)) = (W [a ^U (F(y))}. 

Proof. An optimal stopping time for a problem of ( 3.26[ ) exists (see |20| Chapter 1 Theorem 
2.7) and is the exit time from a open set containing x so we may write r* = T a * A T&* for some 
a < a* < x < b* < j3. Suppose that f3 < b then as shown in the proof of Theorem [3j the value 
function of the optimal stopping problem (3.26) can be written as 



V aj p (x) = inf (c<p (x) - R c (x)) 



(3.27) 



where 

Rc (x) := 

and 



inf 



ap{y)-G{y)F(z)-F{x) , ap (z) - G (z) F (x) - F (y) 



iP(y) F(z)-F(y) 



+ 



^(z) F{z)-F{y) 



ip(x) 



G (y) := G (a) I (a>a] + G (y) I (a , 6) + G (b) I [m . 
As (p is r-harmonic on [y, b) for all y > a, it follows that 

op (y) - G (y) 



-r(x) = E x [(ap{X Ty )-G{X Ty ))e- rT y] 
= c<p(x)-E x [G(X Ty )e- rT y] 
> c<p(x)-G(a)E x [e- rTa ) 



ap (a) — G (a) 
V>(«) 



ip (x) 
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for all y G (a, a). Likewise for y G ((3, b), 

° M %f iy) v> W > <* M - e (ffi ft = W ■ 

Hence, an argument similar to that presented in Theorem [3] can be used to show that 

«c(*) = mf H y) -f iy) )rHx)= inf ^ ~ f ^ (,) =: W. (c) ■ 

2,6(0,6) \ v (y) / we[«,i8] V ^ (y) / 



Thus (3.27) reads 



The case f3 = b can be handled using an approximating sequence of domains as in Theorem [3} 
The argument using the other ratio of fundamental solutions follows analogously. □ 

It is well established that optimal stopping problems based on one-dimensional diffusions 



such as (2.5) exhibit the 'continuous fit' property that V (b) = G (b) for all b G dV and the 
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'smooth fit' property V (b) = G' (b) for all b E dV such that G' (b) and F' (b) exist (see 
Theorem 9.5). The next proposition provides an alternative proof of some properties of the value 
function using properties of the concave biconjugate x \-t G** (x). 

Proposition 8. Take I'd and let G : I' — >• R to be a upper- semicontinuous function. Take 
X to be a Brownian motion with Xq = x under the measure P x which is absorbed upon exit from 



the interval I' and r = in the optimal stopping problem (2.5). 



(i) The function x i— > V (x) is continuous on int (/') where int (/') denotes interior of the set 
I 1 . In particular, x \— > V (x) is continuous on dT> n int (/'); 

(ii) Suppose that y £ C then V' (y) exists and dV (y) = {V (y)}; 

(Hi) Suppose that y G &D and G G C 1 ([y — e, y + e]) for some e > then the 'smooth-fit' 
condition V' (y) = G' (y) holds. 

Proof. (1) In this case V = G** = — cl (conv (-G)) is by definition the smallest concave function 
lying above the obstacle G hence, the 'continuous-fit' property follows from |22| Theorem 10.1. 

(2) Let A := {x G V \ \dV (x)\ > 1} then by (22] Theorem 25.5, A c is a dense subset of I' 
upon which V is differentiable. Take x G A then by definition there exists a non-empty closed 
set fi(x) C dom(G*) such that for each c G /J>(x), the tangent hyperplane h(c,y) := V (x) — 
c (x — y) dominates V on I'. Take d G int(//(x)) then h(c',x) = V (x) and h(c',y) > V (y) 
for all y G I' \ {x}. Due to the upper semi-continuity of G there exists x' G /' such that 
h (c', x') = G (V) and hence G (x) = V (x). 

(3) When G G C 1 ( [y — e, y + e]) the derivative G' exists at y G &D and the unique tangent 
hyperplane is h (x) = G (y) + G' (y) (x — y). Consequently, the characterisation of the continua- 
tion and stopping regions in Theorem [3] is equivalent to 

C = {x G I') dG(x) = 0} ; V={x£l'\ dG(x)^Q)} 

which implies that dV (y) = dG (y) = {G 1 (y)} and hence V (y) = G' (y). □ 
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The third part of the previous proposition shows that when G G C 1 (/') that dV (y) = 
{G 1 (y)} for all y G P and hence it follows from the second part that the set A = or equivalently 
V G C 1 (J'). The previous proposition can be extended to optimal stopping problems such as 
(2.5) when the diffusion has natural boundaries as explained in the next proposition. 

Proposition 9. Assume that X is a one dimensional diffusion with Xq = x under the measure 
P x and such that the functions tp, tp G C l {I). Take G : I — )• M to be an upper- semicontinuous 
function satisfying assumption (2.4) and consider the optimal stopping problem (2.5). 

(i) The function x i— > V (x) is continuous on I and in particular, x i— >• V (x) is continuous at 
any point in dT>; 

(ii) Denote the super differential ofW** at F(y) by dW** (F(y)), that is 

dW„(F(y)) ■.= {ceW\W**(F(y))>W**(z) + c(F(y)-z) Vz>0}. 
IfyeC then V (y) exists and dW^{F(x)) = { ^(V/ip)(x)}. 

(Hi) Suppose that y G dT> and G G C 1 ([y — e, y + e]) for some e > then the 'smooth-fit' 
condition V (y) = G' (y) holds. 

Proof. Define a change of measure using the harmonic function x t— > ip (x) solving the generator 
equation (2.1) using 

P x {A) := -j^ 
ip ( X 



E x [ip (X t ) e~ rt I A ] AeF t n{T r >t},t>0 



(3.28) 



where T r ~ exp (r) is the killing time of the diffusion X under the original family of measures. 



For any z G (a, x] the process the process (ip(X t AT z )e 



-r(tAT z y 



t>0 



is a martingale and hence 



the measure ( |3.28 ) is an equivalent probability measure for random variables which are Ft z 
measurable for some z > a. Consider the auxiliary optimal stopping problem 

V z (x) := sup E x [G(X T )e- rr }. 

T<T Z 



This stopping problem can now be rewritten as problem without killing under the measure 



defined in (3.28), i.e. 



V z (a?) = sup E x [G (X T ) e~ rr ] = V (a?) sup E x 

T<T Z T<T Z 



(3.29) 



where E x denotes expectation under the measure defined in (3.28). The change of measure 
(3.28) is referred to as the 'Doob h-transform' and a property of this change of measure is that 
X remains a regular diffusion under P x (see Uj pp. 33-34). Let S denote the scale function of 
X under P x (see [4] pp. 14 for further details). The measure ( |3.28[ ) is such that scale function 
of X under P x , S, solves S' (x) ^ 2 (x) = S' (x) (see El pp. 33-34). Furthermore, the Wronskian 
defined as 

W fa *) ■= ^ (x) + (x) = tMF' (x) 



S'(x) 



S'(x) 



S'{x) 
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is a constant (see [ij pp. 19) so the scale function of X under P x is S = F (modulo an affine trans- 
formation). Consequently, the process (Yj) t>0 = (F (X t )) t>0 is a continuous local martingale on 
[0, T z \ with initial point Yq := y = F(x) under P x . We may rewrite (3.29) as 



sup E x 

r<T 2 



1 1 (AV) 



swpE x 



f. )(AV ' 



sup E x [W (Y T )] (3.30) 



r<T 2 



where W (y) := (G/ip) o F^ 1 (y). As X is regular under P x , lim^ +00 [y] tATz = [Y] Tz < +oo 
i-^-a.s. for all x £ I. Let 

a s := M{t > 0| [Y,Y] t > s} 



then it follows from [21] Theorem 1.7 (pp. 181) that B s = Y as is a (J r (7s )-Brownian motion on the 
time interval [0, [Y]t z ] and by expanding the probability space the process B can be extended 



to be a Brownian motion on R. Moreover, (3.30) can be rewritten as 



sup E x [W (Y T )] 

r<T z 



sup E x [W{B a )]=:U z {y) 



(3.31) 



r<T, 



F(z) 



where T y := inf{t > | B t < y}. The value function of the optimal stopping problem y \-t U z (y) 



defined in (3.31) has the properties described in Proposition [8] on the interval [z, oo). Take a 
sequence of real numbers (z n ) n >i such that z n+ \ < z n for all n > 1 and linin^oo z n = a. For each 
y G M+, the value functions U z (y) of the optimal stopping problems (3.31) form a monotone 
sequence so the limit U(y) := lim n _5. +00 U Zn (y) is well-defined but need not have a stochastic 
representation under P x as the measure change is not necessarily well-defined in the limit. 

As a consequence of Corollary[7j for each n > the function U Zn {y) = {W[z n ,oo))**{y) f° r an 
y € [z n ,oo) and can be extended to be a concave function on JR + by setting U z „(y) = — oo for 
y 6 [0,z n ). The function £/(y) is the point-wise limit of sequence of concave functions (U Zn ) n >i 
so is concave (see [22] Theorem 5.5) and inherits the properties described in Proposition [8] 
The properties of the functions tp,ij) imply that: (i) the function V(x) = U{F(x))ip{x) inherits 
continuity from U; (ii) V is differentiable at all points which U is differentiable so the second 
assertion holds and (iii) the function y i->- W (y) is differentiable at y' £ {y > | U (y) = W (y)} 
if and only if x i— >• G (x) is differentiable at F" 1 (y'). □ 



This section concludes a basic example, the perpetual American put option. 

Example 10. Take a > and define X to be the solution to dXt = rXt dt + o~Xt dWt with 
Xq = x > where W is a standard Brownian motion. Consider the perpetual American put 
option, the gains function of which is G + (x) = (K — x) + for a strike price K > 0. The risk 
neutral value of this option is 

V(x) := sup E x [{K - X T ) + e~ rr ] = sup E x [{K - X T ) e~ rr ] . (3.32) 

T T 

the equality follows since lim^oo G + (Xt)e~ rt = and hence V(x) > 0. The infinitesimal gener- 
ator associated with the geometric Brownian motion X is 

du 1 2 2 d 2 u 
L, x u := rx— + -a x 

dx 2 dx A 
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and the ODE L^u = ru has two fundamental solutions <p(x) = x and ip (x) = x 2r /°" 2 . Let 
—F(x) = (%fj/tf)(x) = x~ x l a where a := 1/ (l + 2r/<r 2 ) G [0,1]. The rescaled gains function 



associated with the problem (3.32) is 
G(y) :=< 



a ) o (-F)- 1 (y) = Ky a -l for y > 



lim sup 



G(x) 
xf+oo x 







for y = 



iVoie i/iai G(y) = W(— y) where W is as defined in (3.19). The function y \-t G (y) has G" (y) < 

(3.33) 



for all y G R+ and hence to find y \— > G** (y) we need only to find y > such that 

G(y)-G' (y)y = Q. 



The unique solution to (3.33) is y* = 1/ (K (1 — a)) l ^ a and 



G** (y) 

Applying Theorem^ 

V(x) = G**(-F(x))(p{x) = ■ 



G'p*)y for y G [0, y*] 
G (y) for; y > y* 



K 



l+2r/a 2 



. 2r/a 2 £ Qr x y x * 



(3.34) 



2r ^(l+o- 2 / 2 ?-), 

fc — x for x G [0, x*] 

where x* = (y*) a = K/ (l + cr 2 /2r). Figure^ illustrates the original and transformed payoff 
functions, the concave-biconjugate of the transformed payoff and the corresponding value func- 
tion. 





Figure 2: In the left figure, the transformed payoff function G is 
draw along with its concave biconjugate. The original payoff G(x) = 
(K — x) + and the corresponding value function V is in the figure 
on the right hand side. 



Moreover, the continuation and stopping region for the problem (3.32) are 
V:={x£R + \V(x) = G{x)} = [0,x*} ; C := {x G R+ | V (x) > G (x)} = (x* , +oo) . 
which coincides with the established solution (see for example [20] Section 25.1) 
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4 A modification of the Legendre transform 



The purpose of this section is to extend the Legendre transform so that the observations about 
optimal stopping in the previous section can be applied to optimal stopping games. The function 
G represents the payoff of the maximising agent while the function H represents the payoff to 
the minimising agent. The two continuous gains functions G, H are such that G{x) < H(x) for 



all x € I and satisfy the assumptions (2.7) and »2.8v unless otherwise stated. 



Inspired by the transformation used in Theorem [3] and Proposition [9] introduce a pair of 
rescaled gains functions W G : M+ — > M and Wjj '■ ^+ — > K defined via 



and 



W G (y) :-- 



W H (y) :-- 



g+(g) 



limsup^ 



H 



F-\y) 



limsup^ a ^gi 



Under the assumptions (2.7) and (2.8) we have 



lim(W#(x) 

x 10 



W G {x)) 



lim (Wh(x) 



y > o 

y = 

y>0 
y = 

- W G (x)) = 0. 



(4.35) 



(4.36) 



(4.37) 



This assumption can be relaxed a little as discussed in Remark 13 below. These definitions could 
equally well be formulated with respect to the other ratio of the fundamental solutions but for 
clarity we shall focus only on these two expressions. 

The aim of this section is to define and describe a version of the convex biconjugate of the 
function Wh which is modified to ensure that it remains inside epi(W G ). At the same time, 
we define a version of the concave biconjugate of the function W G which is modified to ensure 
that it remains inside cl(M 2 \ epi(W#)). This is achieved by defining a modification of the e- 
sub/superdifferential typically used in convex analysis. 



The main result in this section is Theorem 17 which is the purely analytical version of 



19 Theorem 4.1. Theorem 17 shows that the convex biconjugate respecting the lower barrier 



Wh and the concave biconjugate respecting the upper barrier W G coincide. Although this 
'duality' is hardly surprising considering the geometric method of construction presented here, 
this observation is used in Section [5] to provide a new (purely analytical) proof that the optimal 



stopping game (2.9)-(2.10) exhibits both a Stackelberg and a Nash equilibrium. 

L let 



For a given function f : I — 

l x f (c,p) 
r x f (c,p) 



sup {z < x I f(z) — p 
-- inf {y > x | f(y) -p 



c(z -x)}, 
c(y -x)}, 



with the standard convention that sup0 = — oo and inf = +oo. For ease of notation, let 
1 g( c 'P) := 1 wg(c,V) and l x H (c,p) := Ify^p). The point l%,(c,W H (x)) (resp. rfc(c,W H {x))) is 
the last (resp. first) time the line passing through (x,Wh(x)) with slope c, i.e. the function 
y h-» Wh (x) + c(y — x), intercepts W G before (resp. after) x. 
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Define the subdifferential of Wh in the presence of the lower boundary W as 

d G H(x) := {c G E | W H {y) - W„(x) > c(y - x) Vy G [^(c, rg(c, W H (x))] } . (4.38) 

If the tangent y i— > W#(x) + c(y — x) minorises y i— >■ W#-(y) prior to intercepting the lower 
boundary y h )■ VF G (y), then we refer to c as a 'subgradient of Wh i n the presence of W G at x', 
i.e. c G <9g^ (aj); as shown in Figure [3J Similarly, the superdifferential of W G in the presence of 
the upper boundary Wh is 

d H G{x) := {c G M I PF G (y) - VF G (x) < c(y - x) Vy G [Z£(c, lF G (x)), rff (c, PF G (x))] } . 

(4.39) 

If the tangent y 1— > W G {x) + c(y — x) majorises y 1— > W G (y) prior to intercepting the upper 
boundary y h-> W# (y), then we refer to c as a 'subgradient of G in the presence of H at x', i.e. 
c G d G(x), as illustrated in Figure pi 



1 wW H (s) 




x 2 



Figure 3: The slope of the black line, c, is a supergradient of W G in 
the presence of Wh at xi and a subgradient of Wh in the presence 
of W G at x 2 . 

The 5-subdifferential of Wh in the presence of the lower boundary W G is defined as 

d G H{x) := {c£l| W H {y) - W H (x) + 5 > c(y - x) 

yye[l x G (c,W H (x)-5),r x G (c,W H (x)-5)]}. (4.40) 

When c is a <5-subgradient of Wh in the presence of the lower boundary W G , i.e. c G <9 G G(x), 
it is possible to draw a line with slope c through the point (x,Wh(x) — 5) which minorises 
y h-» Wi/(y) prior to intercepting the lower boundary y h-> W (y). For example G d G G(x2) in 
Figure [i| Similarly, the e-superdifferential of W G in the presence of the upper boundary Wh is 
defined as 

Sf G{x) := {c G K I W G (y) - VF G (x) - e < c(y - x) 

Vy G [Z£(c, W G (x) + e),r* H (c, W G (x) + e)]} . (4.41) 
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When c is an e-supergradient of W in the presence of the upper boundary Wh, i-e. c G d^G{x), 
it is possible to draw a line with slope c through the point (x, W G (x) + e) which dominates 
y i y W G (y) prior to intercepting the upper boundary y h-> W/#(y). For example G d^G(x\) 
in Figure [4} 




Let 



and 



e* c (x) :=inf{eG [0, W H (x) - W G {x)} \ c G d^G(x)} 



5*(x) :=inf{<5G [0, Wh(x) - W G {x)] \ ced<fH(x)} 



(4.42) 



(4.43) 



which are the smallest spike variations that can be made in W G , resp. Wh at x such that 
c G d^G(x), resp. c G dfH(x). The quantities ( |4.42[ ) and ( |4.43[ ) are illustrated in Figure 5l 

Remark 11. It follows from these definitions that for all 5 > 5*{x) 

W H (y)>W H {x)-5 + c{y-x) \/ye[l x G (c,W H (x)-5),r x G (c,W H (x)-5)}. 

Whereas, ford < 5*(x) there exists x' G [l G {c, Wh{x) — S), r G (c, Wh(x) — 5)] such that Wh(x') > 
Wh(x) — 6 + c(x' — x). These two statements imply that either: 

(a) There exists z G [l G {c, Wh{x) -5*(x)), r G (c, Wh{x) - 5*(x))\ such that c G d G H(z) and/or 

(b) 5*{z) = W H (z) - W G {z) for z = l G (c,W H (x) - 5*(x) and/or z = r G (c,W H {x) - 5*(x). 

The top left panel of Figure^ shows a point where only condition (a) holds, whereas the bottom 
left panel illustrates a situation where only condition (b) holds. Similarly, for all e > e*(x) 



W G {y) <W G {x) + e + c{y-x) Vy G [l H (c, W G (x) + e), r x H (c, W G {x) + e)}. 

Whereas, fore < e* c {x) there exists x' G [l x H (c, W G (x) — e), r x H (c, W G (x)— e)] such thatW H \x') < 
W G (x) + e + c(x' — x). These two statements imply that either: 
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(a) There exists z G [l H (c, W G (x) + e* c (x)) , r H (c, W G (x) + e* c (x))] such that c G d H G(z) and/or 

(b) 5*{z) = W H {z) - W G (z) for z = l%(c,W H (x) - 5* c (x) and/or z = r%(c,W H {x) - S*(x). 

The top right panel of Figure [5| shows a point where only condition (a) holds, whereas the bottom 
right panel illustrates a situation where only condition (b ) holds. 




Figure 5: The two figures on the left illustrate S*(x) and the two 
figures on the right illustrate e*(x). 



Furthermore, let 

e*(x) := inf e*Jx) ; S*(x) := inf 6*(x) (AAA) 

ceR cm 

which are the smallest spike variation that can be made in W G (resp. Wu) at x such that the 
set d^G(x) (resp. d G H(x)) is non-empty. The first result in this section shows that there is 'no 
gap' between the minimum spike variation in Wh downwards admitting a 5-subgradient and the 
minimum spike variation in W G upwards admitting a e-supergradient. 

Lemma 12. Suppose that W G : R + — > R and Wh ■ R+ — > R are as defined in (4-35) and (4-36) 
and that (4-31) holds, then: for all x > and c£l 

W G (x) + e*{x) > W H (x)-5*{x) (4.45) 

and 

W G (x) + e*(x) = W H (x)-5*(x). (4.46) 
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Proof. Fix i > 0, c 6 1 and take 5 > 5*(x). It follows from the definition of 5*(x) that 
W H {y)>W H (x)-5 + c(y-x) V y G [l x G (c,W H (x) - 5),r x G (c,W H (x) - 5)} 

and 

[l G (c, W H (x) - 6),r G (c, W H (x) -5)]C [l x H (c, W H (x) - 5), r x H (c, W H (x) - 5)} (4.47) 

where the inequality and inclusion are strict to avoid contradicting that 5 > 5*(x). Due to the 
properties of the line y \— > Wjj(x) — S*(x) + c(y — x) described in Remark 11 , it follows from the 
inclusion (4.47) and the continuity of G that 

lye[l x H {c,W H {x)-6),r x H {c,W H {x)-6)] s.t. W H (x) - 5 + c(y - x) < W G (y) (4.48) 

Let e' := W H {x) - W G (x) - 5 so that ( 4.48[ ) is equivalent to 

lye[l x H (c,W H (x)-6),r x H (c,W H (x)-5)] s.t. W G (x) - e' + c(y - x) < W G (y). 

It follows from the definition of e*(x) that e'(x) < £*(x) or equivalently 

W H (a?) - 5 < W G ( x) + e* (x) V 6 > 8* c (a?) . (4.49) 

Take any sequence of real numbers (d n ) n >i such that 5 n £ (0, 5* (x)) for all n > 1 and lim n _>.oo = 
6*(x) then ( 4.49 ) shows that Wr{x) - S n < W G (x) + e* c (x) for all n > 1. Taking the limit as 
n — > oo of both sides of this inequality we obtain (4.45). 

Suppose that for some c£R that W (x) + e*(x) = Wh(%) — When the assumption 



(4.37) holds the line g(y) := W G (x) + e*{x) + c(y — x) has both sets of properties described in 
Remark 11 so is the only line passing through (x,p) for some p G (W G (x), Wh(x)) which both 
dominates y \-¥ W G (y) on [Z^(c,p), rjj(c,p)] and minorises y h-> Wjj{y) on [/^(c,p), rg,(c,p)]. 
When (4.37) fails, y h-> g(y) may not be the only line with these properties and (4.46) may 
not hold, this case is examined further in Remark 13 below. Consequently, it follows from the 
continuity of G and H and the assumption (4.37) that for any c' ^ c the line y t— >■ h{y) = 
W G (x) + e*(x) + c'(y — x) must either satisfy both 

l G (c',W H (x)-8* c (x)) < l x H (c',W H (x)-6*(x)), 

r x G (c', W H (x) - S* c (x)) < r x H (c, W H (x) - S* c (x)), (4.50) 



or 



l x G (c',W H (x)-S* c (x)) > l x H (c',W H (x)-5* c (x)), 
r x G (c', W H (x) - S* c (x)) > r x H (c', W H (x) - «5*(x)). 



(4.51) 



In the right panel of Figure [6] the line marked (b) has the properties (4.50) whereas in the 
left panel the line marked (b) has the properties ( |4.51 ). When (4.37) fails one (or more) of the 
inequalities in both of these statements can hold with equality which invalidates the following 
argument. Next the line y \-t h(y) is shifted upwards so that it passes through (x,Wh(x) — 5) 
for some 5 G [0, 5*(x)]. As is illustrated by the lines marked (c) in Figure [6] the properties (4.51 ) 
imply that 

l x H (c',H(x)-5) G [l x H (c',H(x)-5' c (x)),x] 
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Figure 6: These figures illustrate the properties used in the proof of 
Lemma IT21 



and hence l x H {d , H(x) - 8) > Vq(c' ', H(x) - 8). Whereas if ( |4.50[ ) holds then 

r x H (d,H(x)-8) e [x,rUc',H(x)-5' c (x))}. 
which implies that rfj(d, H{x) — 8) < r^^d, H{x) — 8). In both cases d ^ d G ' H(x) for arbitrary 



8 < 8*(c). Moreover, as d was arbitrary we have shown that dfH(x) 
may conclude that when for some c G 



equality holds in (4.45) that 8*{x 
argument can be used to show that when equality holds for some cGl equality holds in (4.45) 



for all 8 < 5*(c). We 
= 8*(x). A symmetric 



that e*(x) 



e*(x) from which we deduce (4.46) holds 



□ 




Remark 13. In the previous lemma it is essential to assume that (4-31) holds. When this is 
not the case it may be the case that W G (x) + e*(x) < Wh(x) + 8*(x) as is illustrated in Figure 
[?| Suppose that as in the illustration W G (0) < Wh(0) and there is a x > such that for 
some d G R, d £ d H G{x) but l^(d,W G (x)) = l x H {d,W G (x)) = -00. For this x, W G (x) - 
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c'x < Wh(0). Take a G (W G (x) — dx, W#(0)) such that 3b < d with the properties: (i) a + 
bx G (W G (x), W H (x)), (ii) r G (b,a + bx) < r x H {b, a + bx) and (Hi) b G d H G(r G (b,a + bx)). Let 
5' := Wh(x) — (a + bx) then b G d G H(x) and moreover 5*(x) < 5' < Wh(x) — (a + bx) < 
Wh{x) — W G (x). Thus, by construction d H G(x) 7^ so e*(x) = which implies 



W G (x) + e*(x) < W H (x) - S*(x), 



so in this case (4-46) fails. 



Remark 14. The assumption that (4-31) holds in Lemma 12 can be relaxed if we re-define 
W G (0) = Wh{0) to take some value 



wo G 



lim — : — — , lim 



x\a ijj(x) ' x\a 1p(x) 



and consider the function y 1— > W G (y) (and/or y 1— > Wh(v)) to be multivalued at y = taking 
all values in the interval ^\m x ^ a G + {x)/^{x),wo\ (resp. [wq, lim x ^b H + (x)/il)(x)]). However, the 
choice of wo not only completely determines e)*(0) and e*(0) but the values of the functions 
x 1 — y 5*(x) and x 1— > e*(x) on [0,z) for some z > 0. 




For a given x > 0, define two sets of admissible neighborhoods using 

A x G {c) := (J {y>0\lUc,p)<l x G (c,P)<y<r x G (c,P)<rHc,P)}, ( 4 -52) 

pe[G(x),H(x)) 

A?(c) := |J {y>0\l G (c,p)<l* H (c,p)<y<rMc,p)<r G (c,p)}. (4.53) 

P e[G(x),H(x)) 

These admissible neighborhoods are illustrated in Figure [8j The next result describes a pair of 
functions which coincide with y h-> W G (y) + e*(y) and y h-» Wn(y) — S*(y). 
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Proposition 15. Define a pair of functions 



(W G )^(x) := sup sup (z(x-y) + W G (y)), 
(W H )°(.x) := inf inf (z(x - y) + W H (y)) , 



(4.54) 
(4.55) 



then (W G )*j*[(x) = W H (x) - 5*(x) and (W H ) G *(x) = W G {x) + e*{x). 

Proof. Fix a x > and c G K, it follows from the definition of S*(x) and the continuity of G 



that the set (4.52) satisfies 

A G {c) = [l x G (c,W H (x) - 6*(x)),r G (c,W H (x) - S*(x))}. 
By definition c 6 d G H(x) for all 5 > d~*(x), which is equivalent to 

W H (x) - 5*{x) + c(y -x)> W G {x) \/y G A G (c) 



(4.56) 



and equality holds in (4.56) for y = l G (c, Wh(x) — S*(x)) and y = r G (c, Wh(x) — 5*{x)). Hence, 



and 



sup (W G (y)-cy) = W G (r x G (c, W H {x) - 5* c {x))) - cr G (c, W H {x) - 6*(x)) 
yeA* G (c) 



(W G )^(x):= S np sup (c(x - y) + W G (y)) 



G(z) 



= sup (c(x - r x G (c, W H {x) - 6*(x))) + W G (r G (c, W H (x) - 8*(x)))) 
= suv(W H (x)-S*(x)) = W H (x)-6*(x). 

Thus we have shown that (W G )*^ (x) = Wh(x) — 5*(x) for all x > 0. A symmetric argument can 
be used to show that {W H ) G ^(x) = W G (x) + e*{x). □ 



The previous result holds without the need to assume (4.37) holds. At first glance, the 



notation used in the previous result may appear to be the wrong way around but when (|4.37|) 
holds Lemma 
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implies that (W G )*^{x) = W G (x) + e*(x) and (W H ) G *(x) = W H (x) - 5*(a 



Remark 16. For a given x > consider the sets 



A!(x) 

A 2 (x) 



p e [W G {x),W H {x)\ 



3cGRs 



.t. [l G (c,p),r G (c,p)]CAUc)}, 
P e[W G (x),W H (x)} |3c€Rs.t. [^(c )P ),r|(c,p)]cif( c )}. 



The 'dual interpretation' provided in illustrates that (W G )^(x) can be constructed by max- 
imising over functions of the form y i-> p + c(y — x) which hitW G beforeWu, i-e. (W G )*^(x) = 



supAi(x) as shown in Proposition 15 or by minimising over the functions of the form y \— > 
p + c(y - x) which hit Wh before W G i.e. {W G )*^(x) = inf A 2 (x). 
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ZM-W* 3 (x) 



Figure 9: The left figure shows a situation when Aq(c) C Aq(c) whereas 
the figure on the right shows a situation when A.% '(c) C A%(c). 



In view of the previous remark, Proposition 15 can be viewed as a preliminary version of the 
next result which shows that the functions ( |4.54 ) and (4.55) can be viewed as a generalisation 
of the concave-biconjugate of y ^ W G (y) and the convex biconjugate of y h-> Wjj(y). To this 
end, let 

L x (c,p) = sup{z < x \p + c(z - x) cl(epi(iy G ) \ epi(W H ))}, 
R x (c,p) = inf{y > x \p + c(y - x) g cl(epi(W^ G ) \ epi(W H ))}. 

For a given x > 0, let p(x) = Wh(x) — W (x) and define two sets of admissible neighborhoods 
which are larger than ( |4.52 ) and (4.53) using 

^g(c):= IJ U {y£^ + \L x (c,W H (x)-5)<y<R x (c,W H (x)-6)}, (4.57) 

S&[0,p(x)} c&dfH(x) 

A^(c):= \J \J {y£R + \L x (c,W G (x) + e)<y<R x ( c ,W G (x) + e)}. (4.58) 

ee[0,p(x)] cedf G(z) 

These admissible neighborhoods are illustrated in Figure [9] These neighborhoods coincide with 
those used in [19] and used in the next result which is an analytical complement to [19] Theorem 
4.1. 



Theorem 17. Suppose that (4-31) holds, then the functions x H> (W G )^(x) andx i-> (Wh) g *( 
defined in (4-54) and (4-55) satisfy 



(^ G )^(x) = inf sup (z(x-y) + W G (y)), 
(x) = sup inf (z(x-y) + W H (y)). 

Moreover, (W G )^(x) = {Wh) G * (x) for all x > and 

{x e M+ | (W G )%{x) = W G (x) } = {xeK + | d H G(x) ^ } , 
{x G R + | (W G )h(x) = W H (x) } = {x G M+ | d G #(x) / 0} . 



(4.59) 
(4.60) 
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Proof. Fix x > and cGi and define 

(W G )* H (c):= inf (cy-W G (y)). 
yeA»(c) 

By definition, the line f(y) := W G (x) + e*(x) + c(y — x) dominates y \-t W G (y) on A% (c) = 
[^(c,VF G (x)),r^(c,Ty G (x))] C ,4f(c). If there exists z G ,4f (c) \ «4f (c) such that /(z) = 
W G (z) then either c G d H G{z) or z is on the boundary of A^(c), i.e. z = L x H (c,W G {x)) or 
z = Rfj (c, VF G (x)). Thus we may conclude that (W^ G ')^(c) = cx' — W G (x') for some x' such that 

c(y - x) + W G (x) = W G {x) + e%{x). 

Hence 

inf sup (z(x -y) + W G (y)) = inf (W G {x) - e* z (x)) 



so it follows from the definition of e*(x) and Proposition 15 that 



inf sup (z(x-y) + W G {y)) =W G (x) + e*{x) = (W G )*H(x). 



» \^yx yj ~\~ vv ' ■ 

A symmetric argument can be used to show that 

inf sup {z(x-y) + W G (y)) =W h (x)-5*(x) = (Wh) G (x). 



It follows from Lemma 12 that (W G )*^(x) = (Wg)„(s) and the final statement follows from 
the definition of e*{x) and 5*(x). □ 

The function y i-)- (W G )#(?/) can be viewed as the 'concave biconjugate of W G in the 
presence of y i— > Wij(y)' (or constrained to remain within cl(M 2 \ epi(W#))) for the following 
three reasons: 



(i) Theorem 17 illustrates that the function y i-> (W G )jj(y) can be expressed as 
(iy G )^*(x) = inf (zx - inf (zy - W G (y) + 5{y \ A x G (z)))) , 

zGK \ J/6K y 

where 5(y \ Aq(z)) is the 'characteristic function' of the set Aq(z), i.e. 5(y \ Aq(z)) = 
if y G Aq (z) and <5(y | ^l^-(z)) = oo otherwise. The difference with the standard concave- 
biconjugate is that this characteristic function depends on the choice of c and x. However, 
this dependence seems essential to ensure that epi(W#) C epi((W G )*^). 



(ii) For any measurable function / : R + — > R, the superdifferential of / is as defined in (3.14) 
and the e-superdifferential is defined as 

d £ f(x) = {c G R | f(y) - f(x) - e > c(y - x) \/y G dom(/)}. 

Hence f**(x) — f(x) = inf{e > 0\d £ f(x) / 0}. This definition of a e-superdifferential 
coincides with the definition ( 4.41[ ) when Wh is taken to be the multivalued function 

[W G (0),+oo] y = 
W H {y) = < oo y G (0, +oo) . 

[l^ G (oo), +oo] y = +oo 
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Moreover, when (4.37) holds, it follows from Theorem 17 that (W G )*^ (x) — W G (x) = e 



tGi 



(where e*(x) is as defined in (4.44)) so y h- > (W )*jj(y) and y h-> can both be 



characterised in terms of a smallest spike variation. 

(hi) In Corollary [6] it was shown that the concave biconjugate of y i— )■ (G/tp) o F^ 1 (y) is 
such that {{G/ip) o F -1 )**^) = sup^i(x) where the set ^4i(x) is defined in (3.25). This 
characterisation of the concave biconjugate uses the same method of construction as is 

to define y (W G )# (y). 



used in Proposition 
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The function y h-> (W#) G (y) will be referred to as the 'convex biconjugate of Wq in the 
presence of y i— > W H (y) (or constrained to remain within epi(W G )) for directly similar reasons. 
Furthermore, Theorem [IT] can be reformulated in terms of the F-concavity (resp. F-convexity) 
of the functions G and H determining W G and Wjj- To see this observe that it follows from the 



definitions of y t- > W G (y) and y \-¥ Wjj(y) in (4.35) and (4.36) that 



(G)£(aO := (W G )^(F(x))^(x) = inf sup ( z(F(x) - F{y)) + ( - ) (y) ) ^(x), (4.61) 



zeM F(i/)e^(z) 



G 



(H)g(x):=(W H )g(F(x))iP(x) = S up inf z(F(x) - F(y)) + ^ ) (y) ) ^(x), (4.62) 



which are the modified F-concave/F-convex-biconjugates used in [19 



5 Nash equilibrium in optimal stopping games 

In this section the duality between the modified convex and concave biconjugates proved in The- 



orem 



17 is used to show that the optimal stopping game ( 2.9 )-( 2.10) exhibits a Nash equilibrium. 



The first step in this direction is to show the optimal stopping game (|2.9|)-(2.10) exhibits a Stack- 
elberg equilibrium. This is achieved by showing that (G) H > V and (H)^ < V_ as Theorem 
then implies that V_ = V = {G) 
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)h- 



Theorem 18. Suppose that \2. 7jj holds and consider the optimal stopping game (2.9)-(2.10). 
The optimal stopping game has a Stackelberg equilibrium , i.e. the games has a value V which 
can be represented as 

V(x) = (G)^(x) = (W G y H *(F(x)Mx). 



Moreover, when (2.8) hold, it follows that V 
Proof. Let 

H{x) = 



(G) 



H 



H(x) x G (a,b) 
G(x),H(x)} xe{a,b}. 



Theorem 17 and Remark 14 imply it is sufficient to show that 



(H) G <V<V< (G)*~ 



(5.63) 



where V and V are defined in (2.9) and (2.10) respectively. 
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For the first inequality in (5.63) let A x = U z< z.zAq (z) and f = inf{t > | Xt ^ A x }. Let 



inf A x and b' = sup A x and suppose that b' < b then 



V{x) > inf E x H(X a )e~ ra 

(7<T 



=: V~ (x) . 



where H (y) := H (y) I( a ',b') + G (y) h x =a']i>\x=V] • The stopping time which attains this infimum 
is of the form a = T a * AT),* for some a' < a* < x < b* < b' . As we have assumed that sup^4 x < b 
the process (e~ r ( tAa > ip (X tA g=)) t>0 is a (P x , J r M g:)-martingale. The optional sampling theorem 
implies that E y [ip (X a ) e~ ra ] = ip (y) for all y E and all a < r. Hence for arbitrary c£l, 



= inf ^ H{X a )e 

<J<T 



c<p (x) + inf ^ (ff (X CT ) - (X (T ))e- 



Since (5.64) holds for all c E K, it follows that 



F~ (a?) = sup cy> (s) + inf £ x (ff (X a ) - cp (X a ))e 

ceK V cr<T 



(5.64) 



(5.65) 



The optimal stopping problem on the right hand side of (|5.65|) can be expressed as 
Rc(x) : 



inf E x 

cj<r 



inf 

a'<y<x<z<b' 



(H (X a ) - op (X a )) e- r ° 

( H(y)-cp(y)F(z)-F(x) , H (z) — ap (z) F (x) — F (y) " 



> inf 

yeAx 



H{y) - cp (y) \ 



F{z)-F{y) 



+ 



F{z)-F{y) 



ip (x) 



ip (x) 



Hence, from (5.65) we obtain 



V~ (x) > sup ( + inf 



H (y) - ap (y) 



tp(x). 



Let 



c [x\ 



inf{c E E | inf A x = inf Aq{c)} , c(x) = sup{c E R | sup A x = sup Aq{c)}. 



Define 5*(x) and S*(x) as in (4.43) and (4.44) with H replaced by H where necessary. Due to 

6* c (F(x)). 



the definition of A x it follows that for all c E 

' H(y)-ap(y) \ < £T(s) 



cF{x) + inf 



^(y) y VOO 



and equality holds for all c E [c(x), c(x)]. In particular, it follows from the definition of A x that 
5*(F(x)) = S*(F(x)) for some c E [c(x), c(a;)] so we may conclude that 



V-(x) > H(x) - 5*(F(x))^(x) = (W s )°(F(x))tl>{x) = (H)^(x). 



which is the first inequality in (5.63). The case that b' = b can be handled by using an approxi- 



mating sequence of domains as in Theorem |3| 
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For the final inequality in (5.63), let A x = U z< =z,Ax (z) and let a = inf {t > | X% A x }. 
Let a' = inf A x and b' = sup A x and suppose that b' < b. There is a natural asymmetry in the 
value function defined in (2.11) as R x (t,t) = E x [G(X T )e~ rT ]. Thus 

V{x) = mfsupE x \(G(X T )I [T < a] +H(X a )I [T>a] )e- r ^ 



< sup E x [G (X T ) e~ rT ] =: V + (x) 

T<~a 



Proceeding as above it is possible to show 

V + (x) < inf | + sup 



G(y)-Mv) \ 

m J 



when b < b' . Let 

c(x) = inf{c G E | sup^4. x = supA^(c)} , c(ic) = sup{c G E | inf = inf «4^(c)}. 



Define and e*(a;) as in (4.42) and (4.44) with H replaced by H where necessary. Due to 

the definition of A x it follows that for all c G M 

and equality holds for for all c 6 [c(x),c(x)]. In particular, it follows from the definition of ^Lj 
that = e*(F(x)) for some c G [c(x),c(x)] so we may conclude that 

< G?(x)-e*(F(x))^(x) = (^ G )|(F(*)Mx) = (G)£(x). 

which is the final inequality in ( |5.63 ). The case that b' = b can be handled by using an approxi- 
mating sequence of domains as in Theorem |3| 

The second statement follows immediately since when (2.8) holds we have H(x) = H{x) for 
all x e [a, b]. □ 



Remark 19. In the previous Theorem the assumption (2.1) has only been used to rule out the 
degenerate case that lim sup x ± a (G/ip)(y) = +oo (resp. limsup^ b (G/^)(y) = +oo) as in this case 
the optimal stopping time for the maximising agent is not finite and V(x) = V_(x) = +oo for all 
x £ I. In this case the functions (G)*^ and (H)^ are no longer related to the value function of 
the optimal stopping game. 

In Theorem [18] the functions H and G are defined on the entire domain of the one-dimensional 
diffusion X. Theorem |18| can handle the case that X is absorbed upon exit from a set [c, d] £ I 



by setting G(x) = H(x) for all x G / \ [c, d]. The value function in Theorem 18 can be thought 
of as an elastic cord which is tied to limsup^ W G {y) and pulled towards infinity between the 
two obstacles W G and Wh- On a compact domain it is the shortest path between these two 
obstacles as shown in fl9|. 
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The next two lemmata are used to prove that the game with upper- and lower- value (2.9)- 



(2.10) has a Nash equilibrium. The first step is to show that (G)# G Sup [G,H) n Sub (G, H] 



where 



Sup [G, H) = { F : I — >• [G, H] \ F is finely continuous 

and r-superharmonic on {F > G} and {F > V}} 

Sub (G, H] = {F : I [G,H] \ F is finely continuous 

and r-subharmonic on {F < H} and {F < V}} . 



are the admissible sets in the dual problems defined in (2.12). The second step is to show that 
(G)*h = V and (H)Z = V. 

Lemma 20. The concave biconjugate of G in the presence of the upper barrier H defined in 
{4-59) is in the admissible sets for the dual problems, i.e. 

(G)h G Sup [G, H) n Sub (G, H] . (5.66) 

Moreover, the convex biconjugate of H in the presence of the lower barrier G defined in (4-6Cty 
is in the admissible sets for the dual problems, i.e. 

Sup [G,H) HSub (G,H]. 

Proof. First we show that (G)^ 6 Sup [G, H). Take x £ I such that (G)^(x) < H(x) and let 

M*):=sup{y<x| (G)** (y) = H (y)} ; z + (x) := inf { y > x | (G)** (y) = H (y)} . 

Let G(y) := G{y)\ z _ {x) ^ x)) + H(x)I [y=z _ {x)]u[y=z+{x)] and define a function W using 

W(y;x) := [^\ o F -\y). 
For z E [F(z-(x)),F(z+(x))] =: J x and c G M let 



e r (z) :=inf U> 



W(y,x) < W G (z) + e + c{y- z) Vy e J x } . 



Define e(z) := inf cg R£ c (z), this infimum is attained at some c G M because G is continuous and 
proper on /. We claim that e(z) = £*(z) where £*{z) is defined in (4.42). To prove this first 
suppose that 

e(z) = Ec(z) < inf e*(z), (5.68) 



then by definition 

h(y; z) := W G (z) + e(z) + c(y - z) > W(y : x) Vy G J x 

and in particular h(F(z-(x)); F(x))ip(z-(x)) > H(z-(x)) and h(F(z + (x)); F(x))ip(z + (x)) > 
H(z+(x)). Thus the continuity of y i— > {H/ip) (y) implies that for all z £ J x 

[l z H (c,W G (z)+e(z)),r z H (c,W G (x) + e(z))] C [*_ (x) , 2+ (x)] 
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and moreover c£ d H G^ z ^(z) which contradicts (5.68) so e{z) > e*(z). 



Suppose that e(z) > e*(z) and take d G d^, x sG{z) so that by assumption 
h(y) := W G (z) + e*(z) + c'(y - z) < W G {y) 



for some y G J x \ [l z H (c, W G {z) + e*(z)),r z H (c,W G (x) + e*(z))]. Let c = inf{c G 
d G H(F(z+(x)))} then either: (i) 



c G 



W H (r z H (c, W G (z) + s*(z))) > W H (F(z+(x))) + c(r z H (c', W G {z) + e*(z)) - F(z+(x))) 
which implies that 



h{y) > W H (F(z + (x))) + c(y + e*{z)) - F(z+(x))) > W G (y) 



for all y G [r z H (c f , W G (z)+e*(z)), F(z + (z))}; or (ii) there exists y G [r z H {d , W G (z)+e* (z)), F(z + (z))] 
and b G M such that 

r|,( C / ,W G (z) + e*(z)) = 4(6,^ G (y)) 
and hence %) > + b(y - y) > W G (y) for all y G [r^(c', W G (z) + e*(z)),F(z + (z))]. 



These two cases are illustrated in Figure 10 We may conclude that h(y) > W G (y) for all y G 



(c', W G {z) + e*(z)), F(z+(z))]. A similar argument can be used to show that h(y) > W G (y) 
for all y G [F(z-(z)), l z H {c' , W G {z) + e*{z))}. We may conclude that e(z) = £*(z) for all z G J x . 



H 

















/ 

x ^->W H (x) / 
/ / * »%) 






y^W (y) \ 












m 


y fK(x)) 



Figure 10: In the figure on the left the line h intercepts Wg at a 
point above the line g whereas in the the figure on the right this is 
not the case. However, in the figure on the right h intercepts Wh 
at the same point as the tangent to W G at y intercepts Wh ■ 



Using Lemma |2j for all z G J x the concave biconjugate of W may be written as 

W*Jz; x) = inf ( cz — W* (c; x) ) 
= inf (W G (z) + e c (z)) 
= W G (z)+e*(z) = (W G )* H ¥ {z). 
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By definition z \-± W**(z;x) is concave on J x which implies that x h-> (G)^(x) is F-concave 
on \z-{x), z + (x)]. Consequently, (G)^ is F-superharmonic on [z_(x), z+(x)] and since x was 
arbitrarily chosen (G)# is F-superharmonic on each connected section of {x G I\ (G)^(x) < 
H(x)}. The concave biconjugate y \-t W**(y;x) is continuous on J x (see 
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Theorem 10.1) and 



W»(F(z-(x);x)il>(z-(x)) = ff(z-(x)) , W**(F(z + (x); x)^(z+(x)) = ff(z+(s)) 

so the continuity of x i— > H(x) implies that x \— > (G)^(x) is continuous. We may conclude 
that (G)^ G Sup [G, /Fj since for one dimensional diffusions continuity in the fine topology is 
equivalent to continuity in the Euclidean topology. 

Let H(x) = i?(x)I( a m + G(x)\y x=a tyj[ x =b] then by reversing the roles of G and H and replacing 
H with H in the arguments above it can be shown that (H)** G Sub(G, H] C Sub (G, H] . The 
first part of the lemma then follows from Theorem JTt] as (H)^ = (G)*~ = (G)*^. The second 
part can be derived using a symmetric argument. □ 

As (G)*h G Sup(G,-£f] from the definition of the dual problems V < (G)# and (H)^ G 
Sub [G, H) implies (H) G ^ < V . The next lemma shows that the reverse inequalities hold. 

Lemma 21. The concave biconjugate of G in the presence of the upper barrier H defined in 
(4--61) coincides with the value of one of the dual problems defined in (2.12) and the convex 
biconjugate of H in the presence of the lower barrier G defined in (4-62) coincides with the 
other dual problem, i. e. 

(G)*h = V ; (H)° = V. 



Proof. For the first statement it is sufficient to show that V > (G) H . Fix x' G I such that 
(G)^(x') < H(x') and suppose that V(x') < (G)% (x') = (W G )*/(F(x'))ip(x'). Define another 
set 

Sup[G, H) := {F : M + — > [G,H] \ F is continuous and concave 

on{F > W G } U {F > {W g )h}} 

Let x = F(x') then by assumption there exists / G Sup[G, J?) such that /(x) = W (x) + e for 
some e < e*(x) where e* is as defined in (4.42). Let 

l f (x):=sup{y<x\f(y) = W G (y)} ; r f (x) := mf{y > x \ f(y) = W G (y)} 

so that the function / is concave on [lf(x),rf(x)]. A tangent to / at x can be expressed as 



u(y; x) := /(x) + c(y — x) for c G 



Consider 

l' v :=l x G (c',f(x)+r ] )Vl x H (c',f(x)+r ] ) 



r' v ■= r G (c', f(x) + rj) A r x H {c' , f(x) + rj). 



As d H f(x) C dfG(x) = it follows that either 1' = l x G (c'J{x)) and/or r' = r x G {c'J{x)). 
Consequently, for sufficiently small n > 0, either I' = l G (c', f(x)+rj) and/or = r G {d, f(x)+n). 
Thus f(y) = f{x) + rj + c'(y — x) for some y G [//(x), r/(x)] which contradicts that / is concave 
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on [lf(x),rf(x)]. We may conclude that it is not possible to construct a function / G Sup(G r , H] 
passing through p G [W G (x),W G (x) + e*(x)) or equivalently, it is not possible to construct a 
function / G Sup(G, H] passing though p G [G(x'), G(x')+e*(F(x'))) for arbitrary x' G /. Hence 
(G)h — V an d a symmetric argument can be used to show that assuming (H) G ^ < V leads to 
a similar contradiction. □ 



The next theorem is the main result in this section and shows when (2.7) and (2.8) hold, 
V = V is equivalent to the existence of a Nash equilibrium in the optimal stopping game defined 
in (2.9)-(2.10). As such it is a purely analytical version of one direction of 19 Theorem 2.1. 

(5.69) 



Take 



V + :={x£l\ d H G{F{x))^®} ; 
as the candidate stopping regions. 
Theorem 22. Let 

t* = inf{t > | X t G £>+} 



p- : = { x G 1 1 / 0} 



a* =inf{i > 0|X t G £>~} 



(5.70) 



and suppose that assumptions (2.1) and (2.8) hold. The optimal stopping game (2.9)-(2.10) has 
a Nash equilibrium and (t*,ct*) is a saddle point, i.e. for any r, a 



R x (t,o-*)<Rx(t*,o-*) < R x {t\ct) 



(5.71) 



for all x £ I. 



Proof. When (2.7) and (2.8) hold, it was shown in Theorem 18 that the optimal stopping game 
has a value and V = = 0^ )*»■ The candidate stopping regions (5.69) suggest the following 

candidates for the optimal stopping times 

r* = inf{t > | (G)^(X t ) = G(X t )} , a* = mf{t > | (G)^(X t ) = H{X t )}. 

that V = V = V is r-harmonic on / \ (D + U T>~) and 



It follows from Lemmata 
(G)**(x) = R x (T*,a*). Let 
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and 
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M{z > x | d H G(F(z)) / 0} 



inf{y < x | d H G(F(y)) £ 0} 



and 



y+ = inf{z > x | d G H{F{z)) / 0} ; y_ = inf{y < x | d G H(F(y)) / 0} 



,G i 



(5.72) 



(5.73) 



so that t* = T x+ A T x _ and cr* = T y+ A T y _ . Take any other a = T z+ A T z _ and consider the 
set A x = [x + ,x_]n [z + ,2;_], the following three cases are illustrated in Figure 11 First suppose 
that A x = [x+,x-] then 



Hv) 



(x) + 



F(x+) - F(x. 
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for all y G A x , moreover, h is the largest F-convex function with h(x+) = (G/ip)(x+) and 
h{x ) = [G /ip){xJ) so R x (t*,<j) = h(F(x))ip(x) > R x (t* ,a*). Secondly suppose that A x = 
[z-, z + ] and let 

H\. . (f)W"(f)W 



g(y) 



+ 



F(z + )-F(z. 



<y-F(z-)) 



for y G A x . Define H(y) := H{y)\ x _, x+ ) + G(y)I [y=x _ ]u[y=x+ yk>r y G [x + ,X-], then the convex 
biconjugate of Wh(v) '■= (H/ip) ° satisfies g(y) > W*ff(y) for all y G A x . Moreover, 

2l|implies that Wff{y) = {W G )%(y) so R x (r*,a) = g{F(x))^{x) > R x (r*,a*). Thirdly, 
= [x+, zJ\ then 



Lemma 
let A T = 



f(y) = 



ra\ [f) M ~ (g) ( *-) 



(y - F[x-)) 



and as in the previous case f{y) > Wff(y) and R x (r*,a) = f(F(x))ip(x) > (G)*^(x) = 
Rx(t* ,&*). The final case that A x = [z+,X—] follows by a symmetric argument. Thus we have 



shown that the second inequality in (5.71) holds. The first inequality in (5.71) can be shown 
using a similar argument and thus the stopping times (5.70) are a saddle point. □ 




y»w u (y) 




K*- ) F(x) F(z , ) 



Figure 11: In the figure on the left the line h connects 
(W G {F{x-)) 1 F{x-)) and (W G (F(x+)), F(x+)) so dominates the 
black line Wjj. In the right hand figure the line g connects 
{W H {F{zJ)),F{zJ)) to {W H (F(z + )),F(z + )) and the line / con- 
nects j\W G (F(x-)), F(x_)) to {W H {F{z + )),F(z + )) so both domi- 
nate W^j*. 



The next corollary relaxes the assumptions (2.7) and (2.8) and is a purely analytical version 



of 12 Theorems 4.4 and 4.5. 



Corollary 23. Define F(X t (uj)) = on the event {r = +00} for any Borel measurable function 
F and let 



G+jx) 

x\a tp(x) 



lim 



, ^ + (s) _ 
f& ip(x) 



lim 



(5.74) 
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Then: 



(i) When l a = lb = the optimal stopping game (2.9)-(2.10) has a Nash equilibrium and 
(t*,o~*) is a saddle point. 

(ii) When l a > 0, lb = and there exists I > a such that (G)*^(x) > G(x) for all x G (a, I) 



then the optimal stopping game (2.9)-(2.10) does not have a Nash equilibrium. Similarly, 
if lb > 0, l a = and there exists k < b such that (G)^(x) > G(x) for all x G (k, b) then 



the optimal stopping game (2.9)-(2.10) does not have a Nash equilibrium 



(Hi) When l a > 0, i& = and there exists I > a such that (G)*^(x) = G(x) and/or (G)*^(x) = 
H(x) for all x G (a, I) then the optimal stopping game {2.9\j - ^AU\j has a Nash equilibrium 
and (t*,<j*) is a saddle point. When lb > 0, l a = and there exists k < b such that 
(G)*h(x) = G{x) and/or (G)^(x) = H(x) for all x G (k, b) then the optimal stopping 
game \2.9ty -( 2~T(fy has a Nash equilibrium and (r*,cr*) is a saddle point. 



Proof. Replacing H(x) with H{x) = H{x)I {a b) + G+(x)I[, 
G(x)I (a , 6) + G+(x)I[. 



x=a]U[x=6] 



in Theorem 
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=a\u[x- 



= w and G(x) with G(a 



(G)*~. The function V is extended 



shows that V 

onto the closed interval [a, b] using the convention at the boundaries. When l a = = the 
function V is continuous on [a, b], so the first case follows in exactly the same way as in Theorem 



(2) In the case that l a > extending the function V = {G)*~ onto [a, b] using the convention 
at the boundaries results in V being lower-semicontinuous on [a, b]. In this case there exists 
a maximising sequence of stopping times but their limiting value need not be attained. To 
see this, suppose that x±, y± are defined as in ( 5.72 )-( 5.73) and that x_ V y_ 
T n = T a+ i/ n A T x 
of Theorem 



-x+Ay+ 



a. Take 

then by assumption lin^^oo r n = r* and the approach used in the proof 
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shows that R x (T n ,cr*) < (G)^(x) for all n > 1 and x G (a,x + A y + ) and by 



construction linin^oo R x (T n ,a*) = (G)*^(x). However, using the convention at the boundary, 
R x (t*,<t*) = E x \(G(X Tx+ )I[ x+ < y+ ] + ff(^ + )I [2/+<a;+ ])e-^+^ + I^ +AH+ <T a ] 



fG(x+) F(x)-F(a) 



\tp(x + ) F(x+ 

for all x G (0,2:4. A y + ). Moreover, 
R x (T n ,a*) = G(a + l/n) 



F(a) 



H(y+) F(x) - F(a) 



I [x+< y+ ] + H{y+) 



<p(x) 



F(a) 



[y + <x + ] 4>(x) 



L [y+<x^ 



ij}(x) 



F{x + Ay+)-F(x) 



t/j(a + 1/n) F(x + A y + ) - F(a + l/n) 



+ R x (r*,a* 



Since F(a+) = it follows that 

lim R x (T n ,a*) = l a [ 1 



F(x) 



F{x + A y+) 



^(x) + R x (t*,o-*) >R x (t*,o-* 



as the first term is strictly positive as the function F is strictly increasing. Thus a saddle point 
does not exist as the limit of the maximising sequence is not attained. 
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(3) The situation described above can not occur under the assumptions of part (3) of the 
corollary because in this case it is not possible to take x G I such that X- V y_ = a where x± 
and y± are as defined in ( 5.72 )-( 5.73). The other statements follow using a symmetric argument 
but require us to rescale G, H in terms of the other ratio of the fundamental solutions. □ 

Remark 24. The previous result is heavily dependent on the assumption that F(X T (u>)) = on 
the event {r = +00} as under this assumption (G)# can have a discontinuity at the boundaries 
of I. If instead we extend G and H onto the closure of I using the approach discussed in Remark 



14 the optimal stopping game (2.9)-(2.10) has a saddle point in all the above cases. 



A generalisation of the smooth-fit property in terms of the super- and subdifferentials defined 

Let y t-> W v {y) 



in (4.38) and (4.39) now follows from Lemma 21 and Theorem 
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F (y) where V is the value of the optimal stopping game ([2~9|)-( |2.10[ ) and define d H V(x) (resp. 
d G V{x)) by replacing W G with W v in dOgh (resp. replacing W H with W v in (|4.39|) .) 



Proposition 25. Assume that (2.1) and (2.8) hold and suppose x G T> + and that d (G/ip)/dF(x) 
exist then 



d H V(F{x)) C 



^-W G (F(x)),^W G (F(x)) 



d+_ 
dF 



G\ d~ 
{x) >dF 



(x) 



(5.75) 



which holds with equality when x G T> + \dT> + . Smooth fit is said to hold at x G dT> + when (5.75) 
holds with equality. Similarly, suppose x G &D~ and that d ± H/dF{x) exist then 



d G V (x) c 





\-{ 




dF \ 



(5.76) 



which holds with equality when x G V \&D . Smooth fit is said to hold at x G dT> when (5.76) 
holds with equality. 



Proof. It follows from Theorem 18 and Proposition 15 that the value of the game is V(x) = 
G(x) + £*(F(x))ip(x) where e* is defined in \AA2\ so d H V{x) = d^ {x) G{x) = d£ {x) G{x) for all 
x G F(I). Moreover, the stopping regions ( 5.69| ) can be written as 

V + := {x G I\e*{F(x)) = 0} , V~ := {x G I \ S*{F(x)) = 0}. 

and hence d H V(x) C d H G(x) for all x G T> + . Suppose that x G T> + then y 1— > W v (y) is concave 
on [F(z—(x)), F(z+(x))] where z~(x), z+(x) are defined in (5.67) which implies that W v is 
almost everywhere differentiable on [F(z-(x)), F(z+(x))] (see [22] Theorem 25.5) and the left- 
and right-derivatives of W v exist for all y G [F(z-(x)),F(z+(x])]. Thus, 



d H V{F{x)) 
For all x G T> + \ dV+ 

d H V{F{x)) 



Vx G P H 



^-W G (F(x)), d —W G {F{x)) 
ay dy 
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as for sufficiently small e > 0, V(x + 5) = G(x + 5) for S such that \S\ < e. Suppose that x G dV + 
then either, (i) 3e > such that V(x + 5) > G(x + 5) for all 5 G (0, e) and/or (ii) 3 s > such 
that V(a; — 5) > G(x — 6) for all 5 G (0, e). In the first case 



(* + *)"(?) (*) 



F(z + <5) - F(a;) 
whereas, in the second case 



< 



4 > - (5) (> 



F(x + 5) - F{x) 



*>-($) 



> 



F(x - <5) - F(a; + <S) - F(jc) 

Letting 5 1 in the first case and <5 f in the second case we obtain 



and hence 



d H F(F(a;)) C 



d ^W G {F{x)), d —W G {F{x)) 
ay dy 



Vx G £> 4 



□ 



When F,G,H G C 1 (/), the previous corollary implies that the stopping regions (5.69) are 
equivalent to 



V 



x £ I 



d (G 



dF\i) 



x) G d H G{F{x)) 



V 



x £ I 



d (E 



dF \ip 



(x) G d G H(F(x)) 



We conclude by examining the Israeli-^ put-option introduced in [l~7|. 



Example 26 (Israeli- 6 Put). Suppose that X is a geometric Brownian motion. That is X solves 
the SDE 

dX t = rX t dt + aX t dW t 
where r > is the discount rate and a > is a volatility parameter. In this case 

. du . 1 2 d 2 u. . 

h x u(x) = rx—(x) + -a -^{x) 

and the two fundamental solutions to Lx« = ru are <p(x) = x and tp(x) = x~ 2r / a . Moreover, 



-F(x) 



[X = X 



-(l+2r/a 2 ) 



, F(x) 



and {-F)~ l {y) = y~ a , F- l (y) = y a where a = 1/(1 + 2r/a 2 ) G [0, 1]. Let 

G{x) = {K-x) + , H(x) = (K — x) + + 5. 
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so that the maximising agent has bought a perpetual American put option with strike K > from 
the minimising agent but the minimising player retains the right to cancel the option by paying 
a fixed penalty of 5 > 0. The gains functions are rescaled by taking 



W G (y) 
W H (y) 



\ o(-F)- 1 (y) = (Ky a -l) + , 
o(-F)- 1 (y) = (Ky a -l) + + 5y c 



The functions G, H are illustrated in the top panel of Figure\12\ and the functions W G and Wh 
are illustrated in the bottom panel of Figure 12. The functions W G and Wh are concave on the 
interval [K~ l / a , +oo) and Wh is concave on the interval [0, K~ x l a \. 

The problem is degenerate in the sense that the inf-player will choose a* = +oo and the 
game has the same value as the perpetual put option examined in Example [70| if the concave 
biconjugate of W G minorises Wh, i-e. W G (y) < Wn{y) for all y € M+ which is equivalent to 



8>Wg{K-V a ) 



K 



=: 8*. 



To avoid this case assume that 5 G (0,5*]. On [0,K the function Wh is concave so 



In fact this inequality holds with equality as for all c < Wh{K 1 / a )/K 1 / a 

cy\JW G {y) <W H {y) VyG(0,oo). 



On [K 1 / a ,oo), we can use an approach similar to that used in Example 10, There exists y* 
such that 

W H (K-^ a ) = W G {y*) - 4-W G (y*)(y - 

ay 

This y* solves the polynomial 

5 



K 



+ 1 = K{y) a {l -a)- a{y) a - 1 K i - a - 1 ^ a . 



Let x* be defined as y* = (x*) l l a , then the constant x* satisfies 



(l + 2r/a 2 ) ^1 

which is the same condition as in 
\K~^l a ,y*] we have 

(W G yj(y) = W H (K 



x 

K 1 \K 



2r/a 2 + 



x \ (l+2r> 2 ) 



K 



llj]. Moreover, (M /G )^(y) = W G (y) for y > y* and on 
W G (y*) - W H {K- l/c 



-1/a 



+ 



y* - K- l / a 



K 
6 



+ K{y* 



K 



K -l/a 



-{y-K- l l«) 



(**r 1/a -y , l (K - y- 

K {x*)-y a - K- 1 / 01 x* y ! {x*)- l l a - K~ 1 / c 
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y' 



Figure 12: The top figure illustrates the payoff functions of the 
game. The black line is the value function of the game. The lower 
panel illustrates the transformed payoffs Wh and W the black line 
is the function {W G )*^. 



The function y i— > {W )*jt {y) is the black line in the lower panel of Figu re\l2\ 
According to Theorem 18 the value of this game option satisfies V(x) = (W )#(— F(x))ip(x) so 



V(x) 



(K-x) 

- (K — 3 



r (x_ \ (^)- 1/a -^- 1/Q ,( K _ T *\ (x_\ x-^-K- 1 /" 



for a; < x* 
for x G [x* , K] 
forx > K 



which can be rearranged into the form derived in In this example assumptions (2.7) and 
(2.8) hold so Theorem 22 tells us that a saddle point of the game option is 

t* = inf {t > 0| X t < x*} , a* = M{t > 0| X t = K} . 
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